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Q> ' I. INTRODUCTION 

<N ■ 

In paper [1] a possible way was noticed regarding how a neuron retains or responds to 
periodic stimulation. This new feature was established as a result of computational study 
of the deep differential structure of actual neuron spike trains. We observed, that for many 

S: 

cases the sequences of higher order finite differences, taken from periodically stimulated neu- 
>- ■ ron spike trains, can be divided into several subsequences of approximately equal lengths, 

OO : 

on some of which the changes in monotony of these differences are strongly periodic. On the 
other hand, the presence of chaotic dynamics in neural activity is well known. This work 

o : 

investigates the following problem: In which extent the deterministic stochastic systems 
hold such type of periodic response property, or does our remark from [1] remain valid for 
living matter only? With this end in view, we introduce a new numerical characteristic of 
stochastic one dimensional systems, expressing this kind of hidden and incomplete periodic- 

■ 

ity in a quantitative form. Its computational study on instances of some nonlinear systems 
is presented. We have chosen three one dimensional maps, most frequently mentioned in 
nonlinear dynamics: the tent map, logistic map, and Poincare displacement of Chirikov's 
standard map. The tent map is the simplest system exhibiting the strong chaotic proper- 
ties, while the behavior of logistic map is typical for many one dimensional systems having 
quadratic maximum. The Chirikov map [2-4] has a fundamental role in Hamilton dynamics. 
We study the behavior of one of its ordinates, so-called [5] Poincare displacement. The 
Billingsley-Eggleston formula type inequality as well as a theoretical result on sequences of 



fractional parts, generated by a simple aperiodic map, are also presented. We recall [6], that 
namely these sequences are well accepted for the aims of mathematical and computational 
modeling of randomness. 

Note, that in many problems of nonlinear dynamics (e.g. various neuron mathematical 
models, Duffing equation - will be studied in our subsequent work) namely a one dimensional 
Poincare displacement is of the main interest. Let us also note, that the research of various 
two dimensional maps and three dimensional flows (for instance, the orbits of Rossler and 
Lorentz attractors - see [2], Ch. 1.5.b and Ch. 7.1. b) can be mostly reduced to studying some 
one dimensional systems. In this regard, we recall Bridges-Rowlands general theoretical 
scheme, can be found in [2], Ch. 7.3.b. 

We give some statements of finite difference analysis [1, 7], on which this paper is based, 
and explain our approach. The mentioned new notion, the numerical characteristic 7, is 
some measure of (in certain sense) minimal periodicity, and hence, can also be treated as a 
measure of chaosity. The main claim of this work is that this quantity, being a measure of 
irregularity, is also that characteristic of stochastic system, that is able to change essentially 
its numerical value when the system undergoes a weak periodic perturbation. This feature of 
7 makes it a new tool when researching the problems of weak signal detection in presence of 
strong (deterministic) noise. In particular, it can be used in research of stochastic resonance 
phenomena (see, e.g., [8]). 

Accepted approaches in stochastic resonance problems are the use of power spectrum 
and correlation function. However, in this work we give only the comparisions of new 
measure with Lyapunov exponent, leaving the consideration of spectral characteristics for 
the further work. The criticism on Lyapunov exponent one can find, e.g., in [9]. Because of its 
computation simplicity, the 7 characteristic is well adapted for research of various applied 
problems, where the analytic law of system evolution usually remains unknown. In this 
respect, we note important works by J. Kurths and his colleagues ([10]; see also [11] where the 
approach from [1, 7] to study the seismic time series is applied) on nontraditional measures 
and its applications to studying different chaotic time series in medicine and astronomy. 
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II. THE ABSOLUTE FINITE DIFFERENCES AND A NEW MEASURE OF 

IRREGULARITY 



The differential method, suggested in [1, 7], reduces the research of chaotic properties of 
the orbits X = (x i ) c *L 1 generated by a given one dimensional system to analysis of alterna- 
tions of the monotone increase and decrease of higher order absolute finite differences 

A^Xi = \A^x i+1 - A(-V Xi \ (A(°)^ = x t ; i, s = 1, 2, 3, . . .) . 

In this section we introduce some statements of this approach and briefly describe some 
computations, explaining the basic notions involved in this work. 

Let us have an one dimensional system, generating numerical sequences X = (3^)°^, < 
Xi < 1 from interval (0,1); we impose no restrictions on the system, and the generating 
mechanism can be quite arbitrary. Following [1, 7] we consider a special representation of 
finite orbit X k = (xj)^ =1 , which emphasizes its deep differential structure. Indeed, it can be 
easly obtained, that for 1 < s < k — 1 we have 

A*- 1 '*, = fifc,.-! + Ef-l^AWx, - min (£(-1)^ A^x p ) (1) 

U^2\rC — S 

p=l p=l 



where 



V 



A^x n , , > A^ s 



Hk,s — min{A^- , Xj : 1 < i < k — s} , 



1 A^x p+1 < A^x p 

and it is supposed that J2\ = 0. Hence, one can consider that finite orbits with length k are 
given in some special form: 

Cfc = (r[ k \ r { 2 k \ . . . , r^ } ; /i M , /i fcj2 , . . . , ^ fc>m ; p M , p fcj2 , . . . , p fc , fc _ m ) (2) 

where r<*) = 0.^i s) ^ s) • • • 4_ s (1 < s < m) and 

A*fc,i, A*fc,2, •••,A t fc,m and p fcjl , p fcj2 , ■ ■ ■ , Pk,k-m (Pk,i = A^Xi) 

are some numbers from interval [0, 1]. Here m = rrik are some given numbers which tend to 
00 as k — > 00 and everywhere below we have chosen = [fc/2]. It is important to note, 



that after applying the recurrent procedure (1) the sequence Xk can be completely recovered 
by ( k . For given orbit X, we consider the binary sequences 

xM = (6<T\4 n \---,$\-) (n,fc = l,2,...). (3) 

The method from [7] reduces the study of orbits X to analysis of some conjugate orbits 
v = (^n)^i which terms are defined as follows: 

It is shown [1, 7], that provided some rather general conditions, the conjugate orbits are 
attracted to some Cantor set A of zero Lebesgue measure. 

The main claim is that the periodic response of (weak) periodic perturbation of given 
stochastic system is localized in X^ and its presence can be detected, when considering 
these sequences. More exactly, for that purpose it should be studied the asymptotical (as 
N — > oo) relative volume (i.e. the density in natural series) of the set of all those indeces i, 
for which the changes of binary symbol occur, 

e } = i-<f° a <<<*-!). (4) 

In order to explain how this statement relates to irregularity notion and how the transition 
to chaos occures, let us consider, from such a differential point of view, one of our particular 
chaotic systems - the logistic map x — > rx(l — x) (it is assumed < x < 1 and < r < 4). It 
is well known, that numerical interval [0, 4] is divided into two subintervals [0, r^) and [r^, 4] 
(j'oo = 3.569 . . .), where the orbits X of consecuitive iterates of this map demonstrate regular 
periodic and stochastic and aperiodic motion respectively. We observed how frequently, in 
dependence of the control parameter value r, the changes (4) of binary terms from Eq. (3) 
occur. By this computational way one can find that for each r e [0, r^) there exists some 
index n r such that for all N > n r the finite sequence X^ contains the series with the same 
binary symbol having the lengths tending to oo as N — > oo. However, when r increasingly 
approaches to r^, these lengths are decreased and for r = they become upper bounded 
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for all N. It can be proved [7, 17], that if they are bounded by a number K > 2 then for 
Hausdorff dimension of attractor A we have 

dim{A) ~ 1 " (41n2)(if-l) - 

Let us now introduce, based on such kind of computational experience, the following 
characteristic of one dimensional systems: for an orbit X = (xk)^L of given system we 
define 

7 = 7 (X) = lim,_^. (5) 

Here, ^y(X,N) denotes the total number of those indeces 1 < i < N — 1 for each of which 
equation (4) holds. Further, we consider the comparisions of 7 with Lyapunov exponent A 
(see e.g., [12], Ch. 5 and [2], Ch. 7.2.b): if x k+1 = F(x k ), then 

X = X(X) = hm lf>|^M|. (6) 

This quantity, along with Kolmogorov-Sinai entropy (that for one dimensional system co- 
incides with A), power spectrum and correlation function is one of the most propagated 
measures of chaosity. As the Lyapunov exponent, 7 exhibits a weak dependence on initial 
value xo- 

For the processes, which can be reduced [7] to that ones generating binary sequences, we 
have established (see [17]) the following Billingsley-Eggleston [13] formula type relation: for 
Hausdorff dimension of attractor A we have 

dim(A) < -H(i) 

where 7 is the system response charactersitic defined by Eq. (5), and 

H(x) = x log 2 x + (1 — x) log 2 (l — x) (0 < x < 1) 

is the Shannon entropy function. 

If X is either constant or periodic, then we obviously have 



~f(X,N) = 7 iV + 0(l) (N^oo) (7) 

and < 7 < 1 is rational. According to next theorem (see [7, 17]) this also represents a 
sufficient condition of regularity in sense of definition from [1] (given for theoretical neuron 
spike trains). 

Theorem 1 For the sequence X = ({an})^ =1 of fractional parts, where < a < 1 is 
irrational, the next statements are true: (a) the conjugate to X orbit v = (i/„)^L 1 is a 
periodic sequence; (b) if entire part of I /a is of the form [l/a] = 2 P — 1 (p > 1) then v n = 
for all enough large indeces n. 

This implies, that relation (7) holds for sequences of fractional parts as well. It is well known 
[2, 16], that through use of some canonical transformation, accepted in classical mechanics, 
an arbitrary integrable Hamilton system in fact is reduced to some billiard system in cube. 
In its turn, the billiards boundary behavior, due to results from [14] (see also [7, 15]), is 
reduced to countable set of sequences of fractional parts. It should be also noticed that the 
Lyapunov exponent of every integrable system is equal to zero [2, Ch. 5.3]. In this respect, 
Theorem 1 and results from [14], imply that every integrable Hamilton system appears to 
be a regular system in some generalized sense of above mentioned definition from [1] (see 
[17] for rigorous formulations). 

We note especially, that we are more interested not in numerical value of quantity 7 - 
our main interest is focused on the value of its discrepancy when applying to given system a 
weak periodic perturbation. The computational analysis, partially presented in next section, 
shows that 7 possesses the following basic properties: 

(A) For the most irregular systems 7 is positive; 

(B) When applying to irregular system any small periodic perturbation, 7 is increased; 

(C) Different systems have different rate of increase of 7. 

The second point of Theorem 1 implies that there exist aperiodic (but integrable) systems 
for which 7 is zero. The tent and logistic maps, after applying a stimulation with a small 
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intensity 10 4 demonstrate an increase of 7 up to 25% and 30% respectively, while for 
^-ordinate of standard map the increase rate can be more than 45%. 



III. COMPUTATIONAL STUDY OF 7-CHARACTERISTIC 

The introduced above response coefficient 7 reflects the asymptotical measure of irregu- 
larity of a given system's orbits in respect of changes in monotony of finite-differences, taken 
from the orbit. In the context of remarks from [1] on neural activity, it can be said that 
7 also expresses the degree of ability of given system "to feel" the stimulation and to re- 
spond on it as the living matter does. We study the response properties of three parametric 
stochastic systems — the tent map Ft: 



1 2tx 2x < 1 

F$\x) =t(l-2\--x\) (= <j " ~ ) (0 < x < 1; < t < 1), 

2t - 2tx, 2x > 1 



'2 



the logistic map F^: 

F ( [\x) = rx(l -x) (0 < x < 1; < r < 4), 
and the Poincare ^-displacement X = (9 n )^ =1 of Chirikov's standard map F^ = F<j K \l, 6): 

In+l = In + K Sffi n 

(0 < 1,0 < 2vr; K > 0) 

0n+l = On + In+l mod (2tt). 

Here t, r and K are control parameters. It is well known that for < t < 1/2 and 
< r < Too respectively, the tent and logistic maps iterates has regular behavior while in 
rest part of parameters they mostly exhibit irregular chaotic motion. The K > in map 
F s , so-called stochasticity coefficient, parametrizes transition from local chaos (K ks 0) to 
global "stochastic sea" (K « 1) [2, 4]. 

We have been considering also actual neuron spike trains, obtained from electrophysio- 
logical recordings [18]. However, the data appear to be too short (note that the work [18] 
followed other aims) in order to determine the values of 7 with a sufficient accuracy. 
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Let us now describe the results obtained and to compare the 7-characteristic and Lya- 
punov exponent A. We note, that (see. e.g., [2, 12, 16]) 



while Ai(r) has a complex behavior on numerical interval 3 < r < 4; here, the second relation 
where A^ denotes the maximal Lyapunov exponent of standard map, has been obtained by 
Chirikov for large values of K (see also [12], Ch.5). After computations we found that 
different systems may have different values of 7. The computations show (see Fig. 2) that 
for logistic map Fl and tent map Ft the relation 



holds for all values of control parameter r. Here, < a(r) < 00 is some continuous function, 
which zeroes can be situated only in zero points of A + (r). Indeed, one can see (Fig. 2), 
that our new measure < 7 < 1 always reaches its local minimal values in small intervals, 
containing zero points of A + . 

More or less exact (with preciseness about 10~ 3 ) computation of 7 needs quite large 
number of iterates of given map (tens of thousands). On the other hand, the new measure 
has that important advantage, that is the simplicity of its computation. It can be easily 
implemented just over the data X, without refering to process generation law. In contrary, 
this cannot be said about Lyapunov exponent for which, in order to get an approximate to 
its numerical value, it is usually required either a given system's explicit analytic form (cp. 
Eq. (6)) or rather complex theoretical constructions ([2], Ch. 5.3). By this reason, as for 
computation of 7 we need only the corresponding time series to be available, the 7 is better 
adapted for research of various applied nonlinear problems. 

We were studying the influence of simplest periodic perturbation on the numerical value 
of 7. Namely, let (s^,)^ be a periodic sequence of the form 




7 (r) = a(r)\ + (r) (A + = max{0, A}) 




e n/r is integer 



n/r is fractional, 
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i.e. we let s n = e for the numbers n of the form n — r, 2r, 3r, . . . and s n = elsewhere in 
natural series. Here, < e < 1 and natural r > 2 are pregiven. We call such a sequence 
( s «)^i the perturbation (or stimulation) with intensity e and period r. We have been 
studying the additively perturbated systems 

x e,r = (x' n )n=i where x' n+1 = F(x' n ) + s n , 

where F denotes one of three mentioned systems. Such a perturbated system where F is 
logistic map but assuming that s n is white noise, was studied earlier in series of works ([19]; 
see details in [16], Ch. 3). In this work we deal with an inverse statement, considering F as 
a (deterministic) noise source and s n as a regular signal. For those actual systems, for which 
the analytic shape of generating law F remains unknown (for instance, earthquake time series 
or neuron spike trains; an explanation of quite complex neuron stimulation mechanism can 
be found in [20]), one can consider X €tT as the stimulated system. 

Further, for mentioned systems F we have been studying by computational way the 
properties of the response coefficient 

7 ( e ,r) = l{X etT ). 

First, for different values of intensity e we have considered the problem: how large can 
be the value of function 7 (e, r) for a given intensity e. Particularly, whether for given 
level of intensity e there exist such values of period r, when the response 7 is close to its 
possible maximal value 1? The result obtained, which demonstrate the Figs. 3 and 4, can 
be formulated in the following form: 

for given e the function 7(e, r) has the self-affine structure; 

for given e those values of r, where the function 7 (e, r) reaches its maximal 
(in respect of r) value, are spreaded on the whole natural series and possess a 
positive density in this series; 

the maximal (in respect of period r) response depends on stimulation intensity 
e in nonpredictable way. 
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The second statement implies an important conclusion, that for a given e the "maximal" 
period can be found in natural series with a positive probability. The Fig. 3 presents the 
graph of function 7(5, r) for perturbated systems F with applied stimulations of intensity 
e = 0.0001 and periods r = 2, 3, . . . , 100, computed with a supercomputer (we used Silicon- 
Graphics); the control parameter values are: r = 0.7 for tent map, r = 3.7 for logistic map, 
K = 0.6 for standard map. Compairing graphs on Figs. 1 and 3, one can see that the value 
of 7, which for these three non-perturbated systems are approximately equal 0.49, 0.62 and 
0.35 (see Fig. 1), under stimulation is increased (for different periods r) up to 0.62, 0.80, and 
0.50 respectively. In this connection, let us note the following: if to apply to perturbated 
system F another periodic stimulation with a small intensity, it should results a similar 
increase of 7 (of already once perturbated system). If to continue this process, it seems pos- 
sible to construct for a given stochastic deterministic system a (multiperiodic) stimulation 
of any small positive intensity, which will increase the 7 up to its possible maximal value 1. 
We have also studied the maximal coefficient 

7(e) = max 7 (e, r) (8) 

2<t<oo 

that gives the dependence of maximal values of response on stimulation intensity e. This 
function also possesses the self-affine shape and it is probably possible to study the cor- 
responding fractal characteristics. On the other hand, one can see that this function has 
certain general tendency to monotone decrease with growth of e. This pecularity can be 
emphasized in the following way, accepted in function theory and classical mechanics: we 
consider the averaged function /i s , 

1 Z-eH 



1 r e + s 

H s {e) = - -y(t)5 s (e,t)dt 

S Je 



where 

1 \x — y\ < s 
\x — y\ > s 

and s > is some number. Computations show that for enough small s > the /i s (e) is 
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a monotone decreasing function. This means, that the maximal (averaged) response of the 
(above considered) nonlinear systems is found in the area of small intensities. 
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V. FIGURE CAPTIONS 



Fig. 1. The graphs of 7-characteritic for three different systems F, constructed through 
relation (5), where is taken N = 30000 for tent and logistic maps, and N = 40000 for 
standard map. The value of 7 has been computed for 50 values of control parameters t, r 
and K with the step 0.01 and 0.02 respectively. 

Fig. 2. The graphs of 7-characteristic (solid line) and Lyapunov exponent (dotted line) 
for logistic map with initial value xq = 0.55. (a) Computations made for N = 50000 and 
values of control parameter, starting from r = 3.56 till r = 4 with the constant step is equal 
0.005. (b) Computations made for N = 50000, starting from r = 3.7 till r = 3.9 with the 
step 0.002. (c) The same computations as in (b) with step 0.001. 

Fig. 3. The graphs of function 7(6, r) for three different systems. It is taken e = 0.0001 
and computations made by Eq. (5) and for the same iV as in Fig. I. The systems are: the 
tent map's iterates for t = 0.7 and x = 0.17, the logistic map for r = 3.7 and x = 0.317, 
and the standard map for K = 0.6 and I = 0.5, 9 = 0.2. 
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Figure 1 
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